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ABSTRACT 


A class of sequential procedures for estimating the mean 
of a normal distribution having known variance from quantal 
response data is discussed. This class includes as special 
members the up-and-down method and other procedures commonly 
used in biological assay. A method of evaluating alterna- 
tive procedures belonging to a given subset of the class mime 
presented. This method is essentially an application of 
Wald's decision theory. A loss plus cost objective function 
is used and the efficiency of a particular procedure is 
determined by its ability to satisfy one of Une icourecmum 
teria considered. Criteria are discussed for use with bovtn 
the expected value and variance of the total loss, which 
may be determined from matrix. equations that are derived. 
Two applications are given. The first is an application te 
procedures commonly used in biological assay. In the second, 
an application to the elevation procedure of the precision 
registration technique used by U.S. Army and Marine Corps 
field artillery units, it is seen that under certain con im 
tions, Dixon's modified up-and-down method strictly dominates 


the elevation procedure currently in use. 
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te oo Ca ON 


The up-and-down method is an experimental procedure for 
fee mMevlne te@esmedian of a continuous distribution function 
G from quantal response data. The procedure, which origi- 
feaeeo from besting the sensitivity of explosives to shock, 
is applicable to experimental situations which deal with 
continuous variables which cannot be measured [6]. 

Whe biological assay problem, for example, is an appli- 
cation which has been studied by Dixon and Mood [6], 
meownlee, Hodges, and Rosenblatt [2], Dixon [4], Tsutakawa 
[15] and others. The objective in the bio-assay problem is 
mo decvermine the critical dose of a drug above which greater 
than fifty per cent of the test specimens respond. As Dixon 
and Mood visualized the problem, 


Secriepeoal Gdeoee 15 associated with each insect 


(test specimen), but one cannot measure it. He can 

only try some dose and observe whether or not the 

Grivical d@se Tor that insect is less than or 

greater than the chosen dose." [6]. 

In performing a bio-assay experiment a prescribed number 
of specimens is usually tested at each of several fixed dose 
levels. If the up-and-down method, originally studied by 
Dixon and Mood, is used, some initial dose level in a set of 
equally spaced dose levels is chosen for testing the first 
Specimen. The next specimen is tested at the dose level 


immediately below or above the dose level of the previous 


test depending upon whether there was or was not a response 


on the previous test, and so forth [5]. Note the structure 
of this procedure. A trial is performed using one speci ms 
After the initial trial, the level used in succeeding trials 
of the experiment is determined by the response frenmaa 
preceeding trial. Tsutakawa [15] studied a generalization 
of the up-and-down method in which the number of specimens 
tested per trial is a constant which is at least one. In 
the first trial of Tsutakawa's procedure, which he calls a 
"random walk design", a group of k > 1 observations (that 
is, k > 1 specimens are tested) is made at some level Y4 in 
a set of equally spaced levels. Here, each observation in 
a trial is a response or nonresponse depending upon whether 
the value of the random variable having distribution G is 
less than or greater than some known value; that is, if the 
Specimen responds, then it is inferred that the crigaeam 
value (the median of G) is less than the value used to test 


the specimen. Succeeding trials of the experiment are made 


at levels Yoseees Yes with k observations per trial, deter- 
mined by: 
Yectom 12 Qe ges 
to Tee if ko <d,<k-k°, t>1 (1) 
(Ypsm diya Seles 


where mis the interval between successive levels, Jy bee 


the number of responses on the t-th trial, and k° is a 


predetermined integer such that 0 < k°<k- k°. This 


10 


procedure generates the sequence 1a J,} and is designated 
W(k, k°) by Tsutakawa. Note the differences between the 
up-and-down method and W(k, mom inate latter, 2 trial is 
ia ormed Usiiteeme specimens and the Level used in succeeding 
trials of the experiment is determined by the number of 
Beepolses from the preceeding trial. Notice also that the 
design W(1, 0) is identically the up-and-down method. 

The procedures of concern in this study are sequential 
sampling procedures for estimating the mean of G. The 
purpose of this study is twofold: to extend Tsutakawa's 
procedures, and to formulate a metholology for evaluating 
alternative procedures. The procedures to be studied differ 
from Tsutakawa's procedures, W(k, k°) in that: 


Pale “comassumeo that Gis a normal distribution 
having known variance. 


2) It is assumed that7 , a set of equally spaced 
levels, is finite. 


3) The number N* of trials taken in the experiment 
is a random variable. 


4) The number k of observations taken per trial is 
not necessarily constant throughout the experi- 
ment. 


5) Successive trials of the experiment are not 
necessarily performed at successive levels 
Sey AA oe 


>The discussing his results, Tsutakawa [15] suggests 
Ueteune experimental situation may prompt a widening of 
his class of procedures wherein k and m in equation l 
are permitted to vary. The properties 4) and 5) above 
Somme such Variations. 


ia 


Thus, if 77 is a finite set of equally spaced levels, then 
ez the class of procedures to be studied, is defined as a 
class of procedures for estimating the mean of a normal 
distribution, having known variance, from quantal response 
data which have the properties 3), 4) and 5) given above. 
When both 4) and 5) are restricted (that is, k is constant 
and successive trials are performed at successive levels), 
then Tsutakawa's procedures, W(k, eo belong to G we 
case which is discussed separately as a special case of 
the general procedure inG. 

It is assumed that the experimenter has selected a 
nominal sample size or a nominal number of trials for the 
experiment and can select a set of equally spaced levels 
(this set is a subset of WY) for the experiment which 
include the mean of G. Here, the term "nominal" is used in 
the same sense as used by Dixon [4]; that is, as first 
Suggested by Brownlee, et al [2], some ofthe observatigm 
usually a string of responses or nonresponses, are discarded 
as being indicative of a poorly selected initial level. To 
perform an experiment using the general procedure, the 
experimenter selects a stopping rule which depends upon 
the sequence of responses. He chooses the interval between 
trials; that is, whether successive trials are to be per- 
formed at successive levels or at irregular levels. For 
example, he may desire that the spacing between trials 
decrease when the responses obtained indicate he is testing 


near the mean. He then decides upon the number of 
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observations per trial to be taken and the observation/ 
response combinations which determine whether the next 
orale wile De =pertermea at a higher level, a lower level, 
or the same level. For instance, in the up-and-down method 
the observation/response combinations are 1/0 and 1/1. In 
the first case, the next trial would be performed at a 
eee elevyer while in the second case, it would be per- 
Permed at a lower level. These choices can be made in 
advance because the experimenter knows the nominal sample 
meee et Ler experimentation, the estimate of the mean is 
determined using one of several estimators. 

The general procedure is evaluated by representing the 
Ss ormave Of the mean, derived by use of the procedure, as 
tne level nearest the estimate. This is an approximate 
representation which can be made as accurate as one pleases 
by increasing the number of levels while decreasing the 
spacing petweemmeevels. Thus, the total loss, in deciding 
wme CStimave 1S at a particular level, can be taken as the 
tee ssocraved With deciding that it is at some level plus 
the cost of sampling. Hence, the problem of determining 
an optimal procedure W* in TI, a set of procedures in = under 
consideration, is the decision problem formulated by Wald 
[17]. Matrix equation, derived for the expected value and 
Wememence Of the total loss, are used with one of four cri- 


teria discussed to determine the optimal oCediEes The 


STE approach was suggested by the approach used in 
picoome by Hitvineg [14]. 


iS 


criteria considered consist of the usual Bayes and minimax 
criteria used in conjunction with the expression formgeae 
expected loss. In addition, two analogously defined 
criteria are used in conjunction with the expression for 
the variance of the loss. In the special case, it is@enen7 
that choosing the number k*, of observations per trial 
which minimizes the expected value of the total loss is 
equivalent to finding a procedure which satisfies the Bayes 
CY iene, 

The present study was motivated by a gunnery problem 
encountered by U.S. Army and Marine Corps field artillery 
units. The problem is that of determining a basis for 
corrections to an element of firing data called elevation. 
Here, elevation is an angle to which a gun tube must be 
raised in order that the center of impact of a grove 
projectiles fired from the tube will be at a given distance, 
called the range, from the gun. The procedure, currently 
used to determine the adjusted elevation, is known as the 
elevation procedure of the field artillery registration 
technique. While the origin of the current procedure is 
obscure, it is known to have evolved from earlier procedures 
in use since World War II. After an adjustment phase in 
which the center of impact is moved near a known point 
referred to as the registration point, the procedure essen- 
tlally consists of: observing whether a projectile bursts 
beyond or short of the registration point; then, changing 


the elevation setting after a prescribed sequence of 
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ieepolses Nave been Observed. This pattern of experimen- 
meeron 15 Continued until a nominal sample size of six 
bUrsts have been observed. Then, the adjusted elevation 
mer cOmputed. 

NOuLeewune similarity in the problem of determining 
the adjusted elevation and the bio-assay problem. Para- 
Ohrasing Dixon and Mood, an adjusteaq elevation is associated 
With each registration point, but one cannot measure it. 

He can only try some elevation setting and observe whether 
fen projectile bursts beyond or short of the registration 
momme, tonav 18, observe whether the adjusted elevation is 
less than or greater than the chosen elevation setting. 

It was discovered that Tsutakawa's procedures, which 
include an earlier version of the elevation procedure, do 
not include the procedure currently in use because of pro- 
Pereties 4) and 5) listed above for procedures in the class 
©. Thus in order to evaluate the current procedure and 
some alternative procedures, it was necessary to consider 
eeeaer class of procedures. 

Mhe reader interested primarily in the application To 
Piewelevation procedure of the precision registration tech- 
naigue may omit Sections IIB and IIIC. The reader interested 
in the more general aspects of the problem may omit Section 


IitC-2 and Chapter IV. 


IS 


Tl. THE GENERAGSPROCEDURE 


An extension of Tsutakawa's procedures will now be made 
precise. LetWw = {..., M_4> Ms; M,5+-+} be a set of 
equally spaced levels with interval m where the Mm. are mid- 


points of the set of intervals 








f : 

~3m -m{| {-m m\|/m 3m' 
—/ = yoo PE: 39D ‘Eo ‘ (2) 
For later convenience, let m, be the mean of G. Let ms a 


finite subset of fF) containing m be known to the experi- 


0? 
menter; that is, assume that the experimenter has SULIT ie@iems 
knowledge of the random variable having distribution G to 
select a subset of the levels of 7° for the experiment 
which contains My This can be done without serlous@igee 
of generality because the variance of G is known and the 
experimenter need not know the specific level in })~ which 
is Mo - It is further assumed that the experiment begins at 
some randomly selected level in 7° but, in general, some 
of the trials of the experiment may be performed at levels 
not inywy. Thus, in the experiment described below, a 
random number N* of trials is performed at the levels in 
m° 

In the general procedure, the first trial of the experi- 


A 


ment is performed at level Y, in 77° where a set of kK, 
observations are taken. On the n*-1 succeeding trials of 


the experiment, Ky yeeny nga observations are taken at levels 
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Ce ae determined by: 


Bre 

| | P 
a ‘i (C. Saiasilts 1 Saute ee 

2 . O nee 

ces emt aoa get > 1 (3) 
O 

Y,-7- CO, +mit kK, -— k, S CIS ce 

; 3 2 

where {C,: eee SC, Ct 1} ~- is a sequence of pre 


determined integers which determine the spacing between 
levels at which trials are performed; ee is a sequence 
of predetermined integers which determines the number of 
@eservations per trial; {k,°} is a sequence of predeter- 
teee Integers such that 0 < k.* “ ky - ka as and Jy is the 
Memeer Of responses on the t-th trial. Thus, the experi- 
menter selects a level in} ° for the first trial of the 
sos-timene. “omeceecing trials are performed at levels 


determined by use of the sequences {c.}, owe anid Jaa 


i 
which are known to the experimenter and Jy which the 
experimenter Observes. Each observation is a response or 
Mette Ss DOloescepending upon whether the value of the random 
Mermieabple having the normal distribution G is less than or 
greater than some known value. 

The number N* of trials of the experiment is determined 
by use of a stopping rule 6. Here, the set of stopping 
Goes UNCerweonsideration is such that N* is finite and a 
particular rule 6 depends upon the sequence {J,} in a 
manner similar to that suggested by Brownlee, et al [2] and 


Shae restriction on {C,} emai acusced pe low. 


eye 


used by Dixon [4] in his study of the up-and-down method 
for small sample sizes. For example, if kK, = 1 for alia 
then a typical rule 6 might be to perform six trials of 
the experiment after the first reversal (that is, first 
response after a string of nonresponses, or vice versa) 

in the sequence tJ, }. Thus, for a given performancemem 


the experiment, the number N of observations is determined 


by the rule § and the sequence {k,} from 
N = (2 Sia (4) 


The general procedure described above generates the 
sequence {Y 1, which forms a random walk on the levels in 
™”° 5, and determines N. The general procedure is a modified 
Tsutakawa random walk procedure and will be designated 
W(6, Ky age C.) or simply W when no confusion results 
from the abbreviation. Notice the differences between 
Tsutakawa's W(k, k°) and W(6, eg ks Cee 


a fixed number of observations, the latter uses a stopping 


Instead of 


rule to determine the number of observations. Sequences 


rather than constants are used in W(64, Ky» kK 


determine the level of each trial, the spacing between 


: C,) tS 


levels used for successive trials and the number of obser- 
vations per trial. Notice also that the procedure 

NGS Je, ae C,) = W(S, k, k”, 1) is identical to Tsuta- 
kawa's procedure W(k, k°) except for the rule 6, which has 


been incorporated into the former. Procedures of the type 
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Meo, Ck, aaa 1) will be referred to as a special case of the 
general procedure in -. and will be discussed separately 
below. 

imttmeiewaseve, tie general procedure has been described 
with the performance of an experiment in mind. That is, 
the information known to the experimenter has been given 
and the procedure he should follow has been outlined. In 
eeemwotch follows, the discussion will begin to focus on 
the second purpose of the study--to formulate a methodology 
ier evaluating alternative procedures in.« . Here, it is 
Pemvyenient tO view the general procedure from the stand- 
Meme Ol an e€xperimenter interested in determining which 
procedure among a set of alternative procedures in the class 
te wae. When viewed in this light, the general procedure 


Sees Characterized by two stochastic matrices which 


Mectlitate the evaluation. 


eee wo MATRICES WHICH CHARACTERIZE THE GENERAL PROCEDURE 
If a single observation is made of the random variable 
fevine Gistribution G, then Os and Bs s tie womebaoa ta ties 


of response and nonresponse at the i®) level in fpf 5 are 


eee ote) Ss sa = 0, ser (5) 


Note that if i = 0, then a = G(m,) = 0.5 = Bo: 


Clear from the symmentry of G that there exists levels in 


Ase GS 


tothe sense in which a procedure is best or optimal will 
be clarified below. The term efficiency is also used to 
mean the degree of optimality of a procedure. 


Ie, 


mm”, equidistant from m), say m_,, and m,, such that 


Ile 


0, (6) 


a G(m_,) 


a = G(m.) = 1, 


so that levels my and m, may be taken as reflecting 
barriers. Let 7 be such a subset of 7°; that is, let 

7) = {M_seees My sss m, where the index u is chosen such 
that #)°, the set of levels known to the experimenter, is 
contained in Wi. Thus, it follows that the experiment 
begins at some randomly selected level in WW. Note however 
gst slit C, ¥ 1 for some t, then the Geo! trial of the 
experiment may be performed at some level not in #7. Sup- 
pose, for example that the t-th trial is performed at 


level m and that C, =v, v #1. Then it is possible 


u-1 G 


that the (t+1)th trial will be performed at level Mey? 


a level which is outside the reflecting barrier at level 


5 


ms To get around this difficulty,~ all the levels outside 


Mes and m,, may also be taken as reflecting barriers and 


Che. Yes time. soln C, = Chay < C, + 1, imposed on Gie 


sequence {C,}. Under these assumptions, it follows that 
the sequence {¥ cannot contain two successive levels not 


ol aig 74 ee 


When the experiment ends, the experimenter may compute 


an estimate of the mean of G, say Mm. 


0? using one of several 


Note that this difficulty does not exist in the special 


case where C, = 1 for all t. 


20 


estimators which will be generically denoted Y. This com- 
fiieaclon May be performed using all or part of the data in 


the sequence {Y,; Jad together with N, N*, and m. Now 


”~ 


Mo isin Onewer the intervals Be eu. Piven by equation e, 


the midpoint of which is given by one of the levels in/j/'”; 


NN 


that is, m) may be represented by one of the levels in/)’. 


And since the sequence ee) cannot contain two successive 
few not in 7/7, it 1s reasonable to assume in the general 


bueececdure that Mo 


7. This assumption is not necessary in the special case 


may be represented by one of levels in 


because there Y, is in ae eee Ties, when it is said 
that the experiment ends at a level in™, it is meant that 
Bers ini 77). 

The sequence iY.) generated by W can be classified as 
an integer valued discrete time stochastic process having 
state space 7° = {..., -l, 0, 1,...} and parameter space 
Reel. 2c... ..)} where in 77)” , mo = OMand wie anterval m= 1. 
Expressions tor the one-step transition probabilities that, 
emeemae (t+1)%" trial of the experiment, the process goes 
up a lene, remains at the same level, or goes down a 
ia ama yebe mounds ising§(3) and the fact. that J, is dis- 


tributed binomially with parameters k, and > which is 


ie 
Bingen by (5). 


On perserve the terminology of the up-and-down method 
Riemeerm level” will be used in lieu of the term “state.” 


ao 


Let 


Ps jrirt ¢. 
rs jozi 
Dp, . = (1 = 0; 2i eee (7) 
15d | gq 5 So ane 
af G 
0 otherwise 


denote the probability that the process goes to the j-th 
level on the (t+l) trial given it was at the i-th level 


on the t-th trial. Then it follows = cone) een 


. Ke ke) 3 Kynd 
pi, > Pros see ee 
j=O0 
© 
0 0 “ee oF Kil 3 , em ; 
7 Pr(k, <J,<k,-k, ae 3 j oot B (8) 
Jak, aul 
k [ 
ie k 
a, = Pr(ky-k,°<dpcky) = EG ¥ a: Bae 
jek, -k,° | 


where p,20; r,>0, q,20 and p,tr, +a, = 15 i= 0,2: : 


Now consider the triplet (W, W, Y¥). Let m,, determined 


by use of Y, be represented by one of the levels in W. 
Recall that when the experiment is performed, sampling 
begins at some level in #. Now the actual level in WW at 
which sampling begins is a random variable, say Q, which 
depends upon prior knowledge of the experimental situation. 


Likewise the level in 7 which represents m9 is also a random 


variable, say M, which depends on W, G, and Y. Given the 


ee 





memolet (7/7, W, Y), the joint probability that M = je and 


N=n, given Q = ie/)), denoted by 


MN} Q Cie ‘a |g gala j=aO, ant ae 4UjsN= Nyse e gM), (9) 


can be found using equations 8. Here ny and Ny» the lower 
e@oeeppem bounds, respectively, on the number N of observa- 
tions are finite for a given stopping rule 46 because N*¥ is 
imotre. FOUation 9 1s an expression for the probability 
M@aee one Experiment ends at level je7) after n observations, 
given the experiment begins at level ie). Let & = 2ut+il 
be the total number of levels in W//. Denote by 

245 = Eula (ji) = pee iesuatla |i i eleD 


alee n 


fmemeovditioOnal probability that the experiment ends at 
level j given it begins at level i. Then A = (a; 5) is a 
meee aLOCiastic matrix which will be referred to as the 


maeeeadure Transition Matrix. Similarly, denote by 


1D! 
y fu NIO Cree. Gide) 


9) A En|Q Gee) ee 


ij 


Paiemeendi tional probability that the experiment ends after 


j observations given it begins at level i. Then B = (b;;) 


tera & x (ny - 7 +1) stochastic matrix which will be referred 


IL, 
Memos vhe Procedure Iteration Matrix. It will be shown 
below that the matrices A and B characterize procedures 


gave 23 
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B.. A SPECTAL CASE 


Consider the special cases W(6, ks Ky) Cee W(6, k, eee 
in @. In dealing with these cases, it will be convenient 


to work with the random variable N*, the number of trials, 
rather than N the number of observations. Since Ky = k for 


all t, N, which is easily obtained from (4), becomes 
N= k N¥, (12) 


This change is made to permit easy comparison among pro-= 
cedures having a different number k of observations per 
trial. Since C, = 1 for all t, all the levels in ™# are 
accessible from any level in ™ in a finite number of trials 
(that is, all the levels communicate with each other). 
Moreover, the probability that a particular level in/? is 
selected for the Care: trial depends only on the level 
used and the response obtained on the t-th trial. Hence, 
the stochastic process tY, 5 t>1l} generated by W(6, k, Ke, alt) 
has Jas its state space, forms a random walk on/) between 
reflecting barriers at levels -u and u and is thus a finite, 
irreducible Markov chain. ! 

In particular, the elements of the 2 x & one-step 
transition probability matrix P = (Py 4) are given by (7) 


where from (8) 


lone terminology used in classifying the chain corres- 
wonds to that used by Cox and Miller [3] and Karlin (2a 
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k 
p. = d a? g «J ees oe UL 
aL =o a a 
0 i=u 
| 
=k? = 1 - 
= i el ‘eat rile, 6 spinal (13) 
j=kO+1 
0 i=tu 
( 0 i=-u 
k | 
= d : Ph g, 0 L=—apar il 5 6 a Aral 
ares | 
a i=u 


and use has been made of equations 6 for i=+tu. Thus, P 
has positive elements only on its principal diagonal and 
the diagonals just above and below the principal diagonal; 


Peaateis, F 18 Of the form 


ZS. 


1 0 





iG 


tS Soe See 


12 





where the (2-2) x (2-2) sub-matrix of P which excludes 
the first and last rows and columns of P is a matrix of 
Jacobi [8]. Furthermore, it follows from (5) and the 


symmetry of G that a; = Bs and thus D_ mG CG 


anda; =p, (1 = 0,41,...,tu). With these results ame 


al 
matrix P can be rewritten 
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eh oe es 7 


Note that P has the property that if the elements above the 
Secondary diagonal are transposed, the resulting matrix is 
Symmetric with respect to the secondary diagonal. This 
property will be referred to as reflective symmetry about 
bhe center element Py: Note that if k=l, then KOs O by 


definition and it follows from (8) that 


ee Oe <1) = 0 


meme O5tl, 5.-t(u-1). Thus when k=1 the principal 
diagonal of P contains all zeros. 

The stochastic process {Y,; t>1l} can now be further 
Classified for k>1. To determine the periodicity of the 
chain, it is sufficient to consider the elements r. in P 
and the level 0 [ll]}]. When k = l, ee Om owe aiels i, and 


Vicmemetoa hNastperiod two Simece a return to the starting 


level is possible only in an even number of trials. When 


e7 


ko Py70 and the chain is aperiodic since the processmeag 
reach level O and remain there indefinitely regardless of 
its initial level in 7”. The chain is necessarily positive= 
recurrent because its state space Mis finite; that is, the 
probability that the process returns to level 1 afvemme 
finite number of trials is one. Hence the stochastic process 


{Y t>1} formed by W(6, k, ie 1) is completely classified. 


‘> 
For k>1, the process is a finite, irreducible, apermigaae 
Markov eres and hence stationary probabilities can be 
found for ther caatin 

It was mentioned earlier that one may wish to compare 
procedures of the special case having a different number k, 
of observations per trial. With this in mind as an eventual 
objective, the asymptotic property of the P matrix as k 
increases is next considered. Note that (14) can be written 
o 1 0 i” 


q 


Ta eae 


Ps Po 29 Po (15) 


era 1-P 8 y-Fy-1 Py-1 
2 


If a chain is both positive-recurrent and aperiodic 
it 1s said to be ergodic [3]. Kemeny and Snell [12] call 
a chain of this type a regular Markov chain. 
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ame trem (13), for KO<e , it is seen that 


lim = ila 361 


k7o ea a kr og meal) 
Hence, 
rT _ 
GA aie 
ol | 
ian P| ok gine re ae 
ne 7 0 ” O .= Pps (16) 
lll G hag! 
Chl oly 
- 4) 


where I is a (2-4) x (2-4) identity matrix. Intuitatively, 
Westin > property implies that as the number k, of 
Observations increase without bound, the probability that 
the process OU: eee remains atv its starting level is one, 
fomme— 0, 21,..., £(u-1). This can also be seen from (3) 
by noting that 


em 


Alsakig ae 
ie k7o 


k7o0 


Pr (Y Y Pr (ke< J, <k el w= oe. 


ttl 


ime ene wwe ceculons which follow, the properties of the 
Pwem@e Matrices introduced earlier will be considered. 
First, changes as a consequence of (12) will be noted. Then 
iMemasyMOvObLC properties of the A and B matrices as k 
increases without bound will be considered for a specific 
example. 

1. The A and B Matrices 

The Procedure Transition and Iteration Matrices in 


the special cases are found in a manner analagous to that 


eg 


used above. The resulting expressions can be obtained by 
replacing N by N* in (9)-(11). The i-th row of A is, as in 
the general case, the conditional probability thatueee 
experiment ends at level j given it begins at level i; while 
in this case, the i-th row of B is the conditional prob- 
ability that the experiment ends after j trials Sivemmeee 


begins at level i. 


e. Properties of the A and B Matrices Given the 
Tinie: Ge W, v) 


As a result of the fact that the stochastae process 
ee Com generated by W(6, k, Fae 1) is a finite, irredu- 
clible Markov chain and the parameters k and ee are CONS tea. 
for any particular W, the A and B matrices can be further 
Studied to determine their asymptotic properties as the 
number k of observations per trial for a given trip Bey 
(HW, W, Y). 


Consider the set of procedures, T, in G defined by 


il 
W(S6, k, Kk, 1) = W(S,, k, 0, 1) where the rule 4 is “ee 

Stop the experiment after both responses and nonresponses 

have been observed on two successive trials. For simplicity ,™ 
let #7) = {-2, -1, 0, 1, 2}. Then & = 53; m =e n¥ = 2; 

and, since it is possible to start the experiment at level 

-2 and not obtain a response until level 2 is reached, 


n*y = 5. From (15) the one-step transition probability 


Matrix jes 
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where from (3), 


Py = Preven 

Py = PrtYeyy 

q, = era end 
Pron 

IS cheers inaies: 


ment ends at level M 


ever ©) , 


tok. 


ede = 


il 0 0 0 

Ppa) qy 0 0 
Po 1-2p, Po 0 aay, 

0 q4 1-p4-4) Py 

0 0 1 0 





(8) and (13) for k° = 0, 
mien | ee 0) = BA 
= #2]¥, = #1) = 6," 
fy, = #1) = a," 
Hal) si 2 ieee), =o) 
thevoroeeb 1 it ty uM N*|Q that the experi- 


after N* trials given it started at 


it is convenient to first consider which combi- 


nations of levels and responses are required by Y Ho oO eee 


M at a particular level in 7). 


nk 
y 
t=n*-1 


EG? 
I 
NO) Te 


Here, the estimator, 


% 


n 
d Set 


Ces) 
tea 


vy - 


Paies 


mM; 


ifom the elevation procedure of the field artillery pre- 


cision registration technique (discussed further in IV) will 


be used. 


Note that the estimator (18) requires data from 


Only the last two trials, the same number of trials 


Sil 


specified by the stopping rule; that is, the mean is com- 
puted from the data obtained from trials at two successive 
levels in which result in both responses and nonresponses. 
Note also that in case there are k total responses, then 
(18) reduces to the mean level tested on the last two 
trials. Next, recall that the set of levels M represents 
the midpoints of a finite set of disjoint intvervaleaee 

equal length m, where the level 0 (the mean of G) repre- 
sents the midpoint of an open interval and the reémaijmeae 
intervals are half-open. Here, since m= 1, 7) = {-2,...,2} 


represents the set7or invervyalse 


[ 








S| a ee =3 xl 
ij fe >] 2 te Se 
=z al f2 3) [3 5 | 
28 Oo eis = eee ee eee f : (19) 
‘ al al — 
ig m/, is in the interval (— 5 ; 5) > then my, is represented by 


level 0 and the random variable M is zero. 
It will now be shown that sufficient conditions for 
determining the value of M can be given on the total number 


Jin of responses obtained on the last two trials. If the 


experiment starts at level Gm g.4 si. Ys = 0) and 
tsJ,<k - 1, then it follows from (13 etna Y, = 0 since 
O 

k” = 0. Also the experiment will end in this case after 


two trials regardless of the outcome of the second trial. 
From (18) one can determine upper and lower bounds on the 


total number of responses observed on the last two trials 


ge 


n* 
Jae J 


5 
Z t=n*-1 u 


whieh are sufficient to determine the level of m. ehavOW ela b ts 


lian 1S5 for M = 0 4b must be true that 


< sm <i 
0 


a) Te 


-1 
2 


Maeve = 0, and Y O then it follows from (18) and the 


Il & 
feerechnat N* = 2 that 


| 
A 
aS 
| 
=| 13 
ais 
jo 
A 
NO) foe 


Heo -LE e 


where 8 denotes the greatest integer in x S Lininleetaay 
for M = -l1 and M = 1, given Y4 = 0 and Y, =O it Shellac 
that 2k - | < Jin eee anda < Jin - sl, respectively. 


In a like manner sufficient conditions on Jn for determining 
M can be found for other outcomes of the experiment and 
conveniently displayed at the terminal branches a logic tree 
suetwmae bhnay shown at Figure 1 for Q@ = 0. It should be 


noted that the lower bound condition on Jn determines the 


Peeper eweouma tor M and viee versa. For example, if Yy = 0 
and Y, = 0, then using Cleo mancmee Oe) sone obtains for M = 0, 
x 1 {k al € 
= -—|= + ~ ee 
max mM, 0 E E € 1 5 : 
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i 
Sac c i. < < + € < Jn, for some € 7 0, and 
ie 


masa: Mm. =O — = (2k - ee }+]1=- 


5 ae 


MH 
af O 


ly | 


: k : K | 
Saeec Jin ee = awe area 2 P LOmsceme  ~e=s- 0. Note that 
the number N*, of trials is readily determined for each of 
the tree branches. 


Maes ;oint conditional probability f can be deter- 


M,N*|Q 
Depeemising diagrams such as Figure 1, the P matrix, and 
Cameeetonal probability arguments. Let Ei; boy the werop— 
Tommeey thay the Lotal number of responses obtained on the 
mtv Oo Lrials Satisties the sufficient conditions for 

Mo= j given that the last trial was at level i. In general, 
Umese probabilities are easily obtained except when two 
meee astve trials are conducted at the same level. for 


3 < 


iiewemec, trom Figure 1 note that mee is eens Elgiis; ee) aol icabiovel 


DS) 
0 a 
iow = -, 15 Savisfied by the upper most branch of the 


iGtiecen ual 1S, 


laie=| 0) 


= Pr(Jm - 


52 2 


lds Sater Sa (21) 


Pr(J. , 


And when M = 0, it is seen that 


a5 











Ey 9 = Pr | < Jim < 2k - EE < Jy < k - | 
= pri /Ki +1< 9.43, < 2 - |£] - 1/1 = 
2 il 2 2 1 
- nae s + 1) Ss Ss See a - 1 3 = j 
=] 2 2 2 1 
Pr(l < J, < k - 1) | 
(229 
In a similar manner, one obtains: 
64> Prise k| J, = 90) (ee 
k-1 r 
= a al eS meee | oe = oa = Aan 
£ — ° 
aie Pr(l < J, < k - 1) 
k-1 i 
= Pr(ek - E - J S45 = ek--> jl J, =e 
En 17 > 
ae pr(l <3, ee 
(23) 


2 en i Ce Sek 1|J, =k) = 1 oe 


E59 = Pr(J, = OjJg = k) = 1. 


Note that the Es 43> i#0O, can be expressed in terms of the 

P 
elements of the P matrix given by (17). Also, the d@ememem 
nator of the expressions for Bq 43> j = -1, 0, 1, is By Gia 


equal Go Po: These two relationships were also found to 


hold when Q#0. Note also that Eo 1 and g, _, are the tail 
& > 


i 
probabilities of the conditional probability distribu 


of the random variable Jn given the random variable J is 
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meu 0 Or k and that Es. 
3 


can be shown 


Sig 


a Bi .-4> feel nicdeed. sat 


from expressions similar to (20)-(23) that 


7 2k =) 


eee — 0, =1, +2. Thus, the notation can be eased some- 


feet Che discussion that follows. 
eon tne Markovian nature of the procedure being studied 
M—eomelows that the joint conditional probability, Py N¥*|Q? 
3 


is now easily written for Q=0 using equations (21) through 
(23), the elements of the P matrix given by (17), and Figure 


1. That is; 


Pu Ne] Q (2.2 |c) = Eo 3! Be 6= 2) ¥52))  Pr(yo=1|¥,=0) = DoPy> 
Pu Ne] Q (1,2]0) = B11! Pr(Yo=1/Y,=0)+eq 4° Pr(¥5=0|Y¥,=0) 
= pj (1-p,) + yey, aL. 
Pu N¥]Q (O52 1) = ye Fie 20 | s0) Te 50.0: 
Pu N¥lQ e210) = a Pr(Yo=-1/Y,=0)+e, 4° Pr(Y¥5=0[¥,=0) 
| = Py (1-P,) ie ene 
Py N#IQ (-2,3]/0)= E> 3" Pr(Y,=-2|Y5=-1)*Pr(¥5=-1/¥,=0)=p op. 
Note that 
2 2 
i fu N#|Q Ohm Or ep. tr, hole Eo.43 71> 
0 lea Ih 
since oe = ane. +. = ; 
j (Od 0 1-21 eT 


The probabilities, f Giilee eGo i, can be 


M,N*¥|Q 
ca timiecmit 2 cams lar fashion so that from (10) and (11) 
the procedure transition and iteration matrices can be 


written: 
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Here, as; foeeiemprobability that the experiment ends at 


ioe! |eeiven it gsibarts at lewel 1 and bd. is the probabil- 


J 
ity that the experiment requires j trials given it starts 
at level i. Note that A has the reflective symmetry prop- 
Pee eoar)i1er defined for the P matrix and that B is 
Palmer ric with respect to its center row. 

Next consider the asymptotic properties of A and B 
Peete reases Without bound. First note that the non-zero 


elements of each are exponential functions in k. Since 


Geeeond &. . for j7i are tail probabilities of 


p Ae 1 


i? 
bineomieally distributed variables and thus approach zero as 


k gets large, it is seen from (24) and (25) that 


ici = AX 


— (25) 
WON OK8 
1000 
lim B = |1000{ = B# Cay) 
k>o WOKS 
HORS 
where P* is given by (16). The positive elements in A* will 


Semeererreasto.as the limiting "diagonal" of A. Intuitively, 
these results imply that as the number k, of observations 
Poeeveilal if ancreased; the level of the estimated mean j, 
Meeones tne starting level i, for all levels ic€ 77) except 

i = fu, and the number of trials becomes the lower bound 

nF of N*. Note that these implications are consistent with 
PiewtIiberoretation given for P*. 


In practice A* and B* are of little interest since there 


is usually a physical or monetary constraint on the number 


a0 


of observations which can be taken. A property which may 
be of interest however is the rate at which A and B approach 


their limitiwe sornis., 2 r 


A, (k) Gad... “ice ie (2p 


Ke ai 


li 


B,(k) = (A, b,, (k)), (29) 


iJ 


where Ay. x5 50k) is the receeding difference of x55) with 


reSeecis vouk 
A. X53 (k) = x45 0k) - Key (k-1) 


then it can be shown that 


iin = 
ae ee” (30) 
lim _ 
eo Bees (31) 


Furthermore, there exists a k~ such that for k>k” the ele- 
ments of A on the limiting diagonal are increasing to one 
while all the other elements of A are decreasing to zero. 
Likewise, the elements of the first column of B are "spa 
increasing to one while all other elements are at zero or 
decreasing to zero. 

While the results of this section hold specificaumm 
for procedures a in G and the estimator defined by (18), 
it is believed that similar results can be obtainedqwaes 
other procedures in G defined by W(S, , k, O, 1). “Sie 


is, a change in the stopping rule rT to permit more iri 


4Q 


should not alter the result that as k increases the level 
of the estimated mean approaches the starting level of the 
experiment and that the number of trials approaches the 
iever bound permitted by the stopping rule. 

In a later section, the efficiency of alternative pro- 
cedures in TI. will be examined at which time there will be 


u 


oecasion to refer to some of the results obtained above. 
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Ill. EFFICIENCY OF THE GENERAL PROUEDURe 


In this chapter, a methodology for evaluating alter- 
native procedures in the class ( will be discussequueee 
loss plus cost objective function is used with an approom. 
ate criterion to determine an optimal procedure in a 
manner analogous to Wald's decision problem [17] where 
the space of terminal decisions is 77, the finite set of 
equally spaced levels. No attempt will be made to deter- 
mine the optimal procedure in @, rather it is assumed 
that a finite number of procedures in @, say I, are to be 
evaluated and compared. 

Recall, an experiment ends at some level M in #4 when 
ms determined by use of Y, is at level M. Suppose there 
exists some procedure W* in € , not necessarily in TI the 
set of procedures being evaluated, whose use will almost 
Surely cause the experiment to end at level 0, the level 
of the true mean. Then W* is preferred to a procedure 
which results in the experiment ending at level j, j #0. 

Let H = h(j)(j = 0, #1, ..., tu) be an integeruee 
function which gives the loss incurred when the experiment 
ends at level j. Note that h(M) is a random variable. 
Since it is preferred that the experiment end at level 0, 
the loss h(0) can be taken as zero. The structure of the 


loss function may be known or its form assumed. Indeed, 


the nature of the random variable having the distribution 
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=. 


G or the intended use of ms the estimated mean, may suggest 
MMe OroODpriave structure. If the structure of the loss 
immer lon is unknown, one of several empirically derived 

Meese functions might be used. For instance, one which is 
ieeawent ly cited in the literature is quadratic in the 
distance between the estimate Mm and the true mean ce Fae. 


In this case, 
: 2 ee 
fea — ni j-0) = ni, 32) 


Where 7) 1S an integer weighting factor, might be used. 
Piiemeae the COSt of experimentation is known; that is, there 
is some constant cost, called the "set-up" cost which is 
independent of the number of observations taken, and some 
wero ple COst, dependent upon the number of observations 
Meow, DOtCn Of which are known. Without loss of generality 
define h(j), often called the cost of missclassification, 
meonits of the cost of observations and take the "set-up" 


cost as zero. Then the total loss incurred L, is given by: 
i=. Hee N. Case 


ietamiets AlSO in units of Che cost of an observation. 

In the next two sections the problem of choosing an 
optimal procedure W* from a set of alternatives I is con- 
Smee@ermed, first Using criteria based upon the expected value 
of the total loss and then using criteria based upon the 


VoGmeweenworethe taval loss. Finally, the results of the 
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chapter are extended to the special case discussed in the 


preceeding section. 


A. CRITERIA USING THE EXPECTED VALUE OF THE LOSS 

Given a particular procedure, W in !, if an experiment 
is performed a large number of times and the loss evaluated 
by (33); then the expected value and variance of the average 


reac ieu 1088 5%; are given by: 
BP le eee 
Var [21 =e ore 
Vv Vv s 


where v is the number of replications of the experiment 
[13]. These results express the principle of the law of 
large numbers in that as v increases to infinity they 
ance of the average total loss goes to Zero. Furthermore, 
the average total loss < is approximated by the expec- 


tation of the total loss, given by 
E [L] = E [H]) + E [N]. (34) 


An expression for (34), the expected total loss, which 
depends upon the prior distribution of @, and A ameme 
matrices discussed in the previous chapter, the loss 
function h and the range of N will now be derived. 

Let F in 2 be the distribution function of the wigaiidian 
variable Q with mass function f(i) denoting the probability 
Chat the experiment starts at level i (i = 0, 41,73 


Here % is a set of distribution functions, the elemenmmaaem 


4 


which, in general, are not completely specified. Let q in 
foe a § x 1 ecoltmn vector whose i-th component is a prior 
Peta@meate of fii); that is, q represents a prior distribution 
eee lnen the mass function of the random variable M is 


Biven by 
Se = oO: 5) 


that is, Ey 6d) is the probability that the experiment ends 


eee | (j = Of, +1,...,¢u). If h, is an 2 x 1 colum 


vector whose j-th component is the loss h(j) incurred when 


the experiment ends at level j, then 


u 
nee dye )i= a> Ach, . (36) 
JF-u 


Similarly, the mass function of the random variable N 


is given by: 
By (n) = a” B, (37) 


where By (n) is the probability that The experiment ends 


Tettee ny) Jhaig ny is a 


(ny, aay mex lf column vector, 


after n observations (n =n 


tnen the expected number of observations is given by: 


ny _ 
lei SIN || SS os Ey (n) esc 5 n,- (38) 
n=n, 
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Hence, using (36) and (38), the expected total loss 


given in (34) can be written 


=a, —= 


E (lL) = q (Ah, + Bn,) = q™F; (399 
where 


r= Ah, + Bn, = EB [L/Q] (40) 


is a & x 1 vector of conditional expected total losses. 
Note that the components of r depend upon W. In fact (40) 
represents, using Wald's notation [17], a vector valued 


funnel ion 
a= (41) 


the i-th component of which is the expected total loss 
(risk) given the experiment starts at level i; i = 0, 
tl,...,tu. Likewise the expected total loss is equivalent 


to Wald's average risk function [17]; that is, 
B [b= -q “f= tee nce (42) 


Note that in case there is no loss associated with an 
experiment that ends at level j (that is, h (j) = O})mer 
all j), then (39) reduces to the expected number of obser- 
vations given by (38). Given a prior distribution on Q, 
it is clear that the expected loss may be determined from 
(39) for each procedure W inT. The remainder of this 
section is devoted to a consideration of decision Craver 


that might be used in finding the best procedure in IT. 
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iw Sayes Procedure 


A procedure W* in [I which minimizes the expected 


total loss over all W in I’ may be regarded as an optimal 


procedure [17]. More precisely a procedure W* such that 
= rk (6 we) = Min x (9 
le eo We) a re (Ww), C13) 


[/wealiled 2 Bayes procedure in fl relative to q. Thus, if 
Menomeintormation on the distribution F exists and is known 
to the experimenter, he may evaluate alternative procedures 
jin the set | using the Bayes criterion as a measure of the 
Seeemiel procedure's efficiency. Such conditions may arise, 
[i—m=reample, as a result of pilot testing. Indeed, in the 
elevation procedure of the field artillery precision regis- 
Traction technique, discussed in IV, it is often possible to 
Seveim such information. Note that in case the distribution 
F is such that the experiment starts at some level i with 


probability Oile. Gnete. 1S. Li 


q=e, (44) 


a 
where es fiw Sieeco lume veclLor Having one as its i-th 


component and zero elsewhere, then (39) becomes 


Dolby Jlyge Sresg Saline (SO gece. o See) 


The set of vectors defined by (44) is called the set of 
unit vectors in Euclidean 2-space and will be denoted 


Coe 


47 


ec. Minimax Procedure 


A procedure W* in I such that 





2. By ee x) — Min max _y/ > 
Be ré(q*, WwW) Wel eg r¥(q, W) (45) 
is called a minimax procedure [17]. In some circumstances, 


particularly if the prior distribution on Q is not Ki@aia 
minimax procedure may be regarded as an optimal procedure. 
Here one first determines for each W a vector q (a distri- 
bution) which is most unfavorable (that is, results in the 
largest expected loss) and then chooses W* to minimize the 


effect of the unfavorable distributions. 


B. CRITERIA USING THE VARIANCE OF THE LOSS 

Now suppose some procedure W inT is known to be optimal 
with respect to one of the criteria discussed in the previous 
section. In some circumstances, W may be the optimal pro-~ 
cedure for performing the experiment. But in other circum- 


stances, it may be useful to know the variance of the total 


OSS 


Var [L] = Var [H] + Var [N] + 2 Cov [H, N] , (46) 


where Cov [H, N] is the covariance of the random variables 
H and N, before the "best" procedure can be selected. An 
expression for the variance of the total loss, simil=rere 


the matrix equation given by (39) for the expected total 


loss, will now be derived. 
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ret he bee ee column Vector whose j-th component 


is [h (iia that is, the square of the loss incurred when 


Piemexperiment ends at level j (j = 0, t1,..., tu). Let 
ny be a (ni -n, + 1) x 1 column vector, 
(n, )? | 
Ns | 


bow?) 


iemeeeielows that the second moments of H and N, respectively, 


are: 
ne PS Rly aw a 
= Se ints )]) = ag A hy, (47) 
jr-u 
n 
a2. ok 2 ae = 
ea. = 1D Ey (n) tae CB Ny» (48) 
n=n 
lke 
where use is made of (35) and (37). Hence the variance of 


Peete (4/7) and (36), can be written in matrix notation 


2 


Var (H] = E [H°] - E* [4] 


- 


q An, -q Ah, hj eel, wee (49) 


Likewise, the variance of N can be written as 


2 


Var [N] = E [N°] - E 


T 
Q 
us 
= 
DO 
] 
1Q | 
LK’ 
KH 


Bn.n- Bq, (50) 


beOmesUbeuitution of (40) and (38). 
The covariance of the random variables H and N is given 


by 
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Cov [H, N) = E [HN] - £& [H] ° E [N}, (Sie 


where the second term on the right hand side of is known; 
that is, using (36) and (38) the product of the expected 


values of H and N can be written in matrix notations 


BLA eae Ah ny Bd: (52) 


The product moment E [HN] can be found from the joint con- 
ditional probability mass function of the random variables 
M and N, given the random variable Q. Recall Pu wlq6d ml) 
gives the probeba lie stnareene experiment ends at level j 
after n observations, given it starts at teaver i. 
follows that the conditional product moment of H and N, 


given Q@ can be written: 


1b) Ny, 
E C(HN|Q=i]l= ¢ Eonef (J ,n|i) ‘h(a 
_ = M,N |Q 
=-u n=n 
L 
for i = 0,-1.5, 2 u. Weg ee (ey) &@ 2X 2 Mepis 


called the Product Moment Matrix, where: 
eT n: Pu nq ce ae 


then the conditional product moment of H and N, given Q is 


the scalar product of the i-th row of C, denoted C and 


i? 
the vector ie That is, equation 53 becomes 


E (HN |Q> => air ms Cyh, 


ang it folilg@w®@ that 





E [HN] = <= Pr (Q=i) - C,h =e Woe a (54) 
1=-u 


tinge, (51), the covariance of H and N, can be written 


@o, SiH soN)] = g Ch, - q Ahjn; Bq (S5)) 


The variance of the total loss, equation 46, can now 
be written in matrix notation using (49), (50), and (55). 


After some rearrangement of terms one obtains 


Mar [hle= ¢ (Ah, ve IE 2Ch,) 
- q (Ah, hy ee Bn ny BY + 2Ah,n, B )q 
= @ Ge ye, (56) 


where 


c= AN, + Bn, 1 eCh, 


iteea © x 1 vector and 


D = Ah, hy A + Bn ny loi eAh ny B 


(Ah, a Bn, ) (Ah, + Bn, ) 


=r r 


(57) 


Poo xX veMaurix and ris the & x 1 vector of conditional 
expected total losses defined by (40). 

From (56) and (57), it is seen that the variance of the 
total loss is easily determined for a particular procedure 


feet Siven a prior distribution on @ and the r vector. 


oak 


But again one is confronted with the problem of choosing 
an appropriate criterion. Two criteria which may be used 
with (56) are considered below. 

1. Minimum Variance Precedure 


A procedure W* in I such that 


min 


Var [Lb] = vteCq We) ae een eee) (58) 


will be called a minimum variance procedure in I relative 
to q. Here, perhaps a certain amount of liberty has been 
taken in that (58) is defined analogous to (43) and thus W* 
might appropriately be called a Bayes variance procedure. 
An analogy also exists with minimum variance estimators in 
statistics which appears to be more related in the context 
used here, so that the first mentioned terminology will be 
used. Hence, if a prior distribution exists and iS ime 
to the experimenter, he may, as when working with the Bayes 
criterion, evaluate alternatives in I using (58) as a 
measure of the optimal procedure's efficiency. Note that 


if q is a unit vector as defined by (44), then (56) can be 


written 
Var {[L) = e,c - e, De, 
OG wea as CA = 0 ye dl noe ee 
eo. Minimax Variance erecedaure 


Consider the variance of the total loss given by 


equation 56 above. It is known [10] that (56) is convex 


Be 





@mmmoencave depending upon whether the matrix of the quad- 
fremont orm, —D, 18 poSitive Ssemidefinite or negative semi- 
feomiimee. Hence, it must first be established that the 
Dive 15 pDOSItive semidefinite before discussing 
maximization of (56) with respect to q. 

inmes, 1b is seen that D=rr. Since ris a & x1 
feerore tts rank is 1 < & and it follows that Dis a posi- 
tive semidefinite, symmetric matrix, and is singular [9]. 
Henee, —-D is negative semidefinite and the quadratic form 
given by (56) is concave. 

Now consider the quadratic programming problem of find- 


ing a q* which 


maximizes q* ¢c - q~ Dq 
Sueeeu cerq 1 = 1 
ee oo) 
q > 0 
filewes Oe is the zero vector and 1 = (1,..., 1)”. Since the 


eeewect teasibile solutions form a convex set and the objec- 
Pewee on 1s concave, 1t is known from the theory of 
Gemvex Tuncpicons [10] that any relative maximum is also a 
global maximum. (In this case the global maximum is not 
unique since the quadratic form is not strictly concave.) 
Thus if a feasible solution to (59) exists, one may find 

a prior distribution q* which maximizes the variance of 
PMtestOval loss, @iven by (50). Note that if q is a unit 
vector, then the solution to (59) may involve integer pro- 


Pe imine eechnigues since it must be true that qd, = ils 


5S 


q = 0 for all j # i to satisfy the constraints of the 
problem. 
An additional criterion may now be defined. A pro- 


cedure W* in [T such that 


= mi —. = —, a 
Var [L] = v*® (q*,W*) = oa =o (q° e-q’ Dq) (60) 


will be called a minimax variance procedure provided a 
feasible solution to (59) exists. 

For a detailed discussion of techniques which can be 
used in solving (59) the reader is referred to Hadley [10]. 
It should be noted that maximization of (59) may be facili- 


tated by the transformation 
q = oR -z, 


where R is a & x 2 non-singular matrix such thay 





The reader is referred to Anderson [1] for progiGmenee 


exists and a method for its construction. 


C. THESSPEe Oi Chae 


In the special case, development of the expressions for 
the total loss, the expected total loss and the variance 


of the total loss follow arguments similar to those given 
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above for the general case. The arguments are not repeated 
Meee ravher diiferences in the resulting expressions as 
a consequence of (12) are noted. 


Mine total loss is given by 


= eel. Gon) 
nT n,* see (nit = nF + 1) x 1 eolumn vector 
i, 
IG 
nt = | . 
n*y 


and ig 1S! (ni = n* + 1) x 1 eolumn vector 


(nt) 


cnt)? 


then the expressions for the expected value and variance in 





meewiumber of trials can be obtained by substituting n* 


for ny and n% for as in (38) and (50), respectively. The 


eeeecucd Cotal loss is 
E (LJ) = q7 (Ah, + kBn# ) = 6 oe. (62) 


Paemenne Variance of the total loss is 


5 


eC 


Var [L] Var [H] + k° Var [N*] + 2k Cov [H,N*], 


. “ae ae ee 1 
= q (An, tboe eeach.) 


- q° (Ah, hy A+kBn}n¥” BY + 2kAhjni” Bo )q 


— 


=q e-q Dq (63) 


where in this case the covariance of H and N* is obtained 


(55), SUDStitputineen® tera 


from (53) ; 1? 


= 2% ae 
AGE KP Bae pees. 


Cc 


S 
I 


i = pas a 
(Ah, + kBn?) (Ah, + kBn?) . 


Obviously, one of the criteria defined by (43), (45) or 
(58), (60) can also be used in the special case. The 
problem, once one of these criteria has been selected, 
reduces to one of evaluating (62) or (63) for all procedures 
under consideration and then selecting the procedure which 
best satisfies the chosen criterion. 

In the remaining paragraphs of this section, the specific 
example introduced in Chapter II will be continued. First, 
it will be shown that the Bayes procedure in the set eT can 


be found by analytical methods. Then an evaluation of some 


of the procedures in rs will be discussed. 


al ee Henoing the Bayes Procedure Given the lriptew 


(mr, W, ¥) 


Consider the set of procedures IT, defined by 


1 
WCS,, k, 0, 1) on A/ = {-2, -1, 0, 1, 2} introduced in 


II B 2. Recall the rule eT 1s to stop the experiment after 
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both responses and nonresponses have been obtained at two 
Bie@eescscive levels and that N*e {2,..., 5}. 

mer cthnis set of procedures, the experimenter might like 
to know if there exists a number k*, of observations per 
trial which minimizes the expected total loss given by (62) 
mememeeeiven prior distribution and loss structure. For 
~eomole, he may be faced with a constraint on the number of 
trials for the experiment rather than on the total number of 
Mierteyavions. ouch a situation may arise, for example, when 
@oere is a significant time lapse before response data can 
be observed. At any rate, a procedure with k* observations 
per trial is a Bayes procedure. To see this, note from (62) 


meee) that 


Bella) =e (Ah, + kBn# ) =r* iq, W). 


Since k is the only unknown in W(S,; a eos it follows 


from (43) that the procedure W(6 k*, 0, 1) is a Bayes 


Le 
procedure. The experimenter may also be interested in 
knowing if there is a relationship between the number of 
Siveervations per trial and magnitude of the loss incurred 
from making a wrong decision. For example, if it is pos- 
Sible that the loss might be higher than he anticipates, he 
may be interested in knowing whether he should take a 
larger or smaller number of observations per trial. 

For definiteness, suppose that the loss function is 
the quadratic function given in (32). Then the expected 


wii Loss can be written 


a 


Eo = o> SC neeae kBn# ) (64) 


al 


where 


(65) 


4 
w 
JU) 

UW &S WwW 


and A and B are given by (24) and (25) respectively and 7 
is a loss parameter which determines the magnitude of the 
loss. The Bayes procedure may be found by minimizing (64) 
Wit Srespect er o sia 

Since it is assumed that q, the prior distribution 
Q@ is given, it is sufficient to consider minimi Zaesssaee 


the components of the vector r, of conditional expected loss, 


+ kBn* (66) 


r=r (k,n) = nAh, 1 


Note that the components r can be made arbitrarily large for 


a given n by choosing k large; that is 


2 
lim — lim 


K-00 ~ ¢-+00 nN lo + k 
il 


ah ae 


where use has been made of (26), (27) and (65). Next y™=eome 


, (67) 


i PO eo Te 


sider minimization of r. Differencing (66) with respect to 


xk ylelds 
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‘vane @e, Wr = nA, Gs) hy + kB, (k) n¥ + B(k-1) ay (68) 


where A, (k) and B, (k) are defined by (28) and (29) res- 


Deeccively. It can be shown that if n = 0, then 
AL? Olan mesa ce 


Meek > 1; and if jn > O, then the existence of k* > 1 
tren minimizes r depends on the magnitude of n. Thus, in 
this example, the conditional expected loss is minimized 
emeaking k = 1 when n = O or by finding k* > 1 ifn is 
Smepuetently large. For k > k*, r is increasing in k. In 
m2cet, here 

Aaa 


= = z n* = 
A,r (k, n) er oe n¥ 


lim 
k-0o 


ee ino re 


where use is made of (30), (31), and the fact that 
Isabel 


k>0 | 


kB, (k) = 0. Given that Q = i andn is sufficiently 


large, k* is that k which satisfies, 


AY temas Gleseaeini)s) <a) 


ke 


ALY a alli gp ual a9 3 


Now consider the change in (68) as n changes 
AS or (ky n) = AJ(k) i 
kon , 1 ri 


[Mmeansbe shown that there exists a k~ such that for k>k’, 


9 he 
em (Che 2 ii) ec 10 


De 


a result which implies that the expected loss can be 
decreased for high loss structures by increasing the number 
of observations per trial. 

It follows from the above that for the set rs of pro- 
cedures defined by W(S, ; k, 0, 1) and a quadratic@tee. 
function that the existence of an optimal number k*, of 
observations per trial depends only on the magnitude of the 
loss which may be incurred from deciding that the mean of 
the distribution being sampled is at some level other than 
zero. That is, if there is no loss incurred by (time 
decision, then one observation per trial should be taken; 
otherwise more than one observation probably should be 
taken. Also, it was shown that choosing W in rs by finding 
a number k*, of observations per trial which minimizes the 
expected total loss is equivalent to finding a procedure 
which satisfies (43), the Bayes criterion. 

Comparing procedures in the set Pas discussed above, 
with Tsutakawa's procedures has been avoided because of 
the limitation imposed by the stopping rule 54> a rule 
selected because of its simplicity and applicabi lipase 
the elevation procedure of the field artillery precision 
registration discussed in Chapter IV. Using the rule 65> 
it is noted that the up-and-down method (that is, k = 1) 
does not perform well when compared to procedures in rs 


with k > 1. It will be seen in IV that its performance is 


considerably better under a more liberal stopping rule. 
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meageod. a limitation in evaluating procedures of the 
Special case is the fact that comparisons are made over 
procedures where the total number of observations (sample 
size) varies drastically. As mentioned earlier, this 
Peeplation may be realistic if the experimenter is faced 
[ere CONStraint on the number of trials rather than the 
Meter number of observations. 

Mec arseullau., tm the special case, whether or not 
there exists a number k* > 1 of observations per trial 
Reecieimininmizes the expected total loss depends upon the 
nature of loss function and the stopping rule, 6. While 
@@emresults of this section hold specifically for the stop- 
ping rule FT and the estimator defined by (18) it is anti- 
cipated that similar results should be obtained for 
meePemme rules which permit a larger number of trials and 
Svger estimators. 

ein Evaluation of Some Procedures in rs 

In order to illustrate the techniques of evaluation 
which have been discussed, it was decided to evaluate the 


loss characteristics for some procedures in I. using data 


1 
generated by a high-speed didgital computer. Recall that 

rs is the set of procedures considered in the example intro- 
duced in section II B 2 and continued in the preceeding 
section. A computer program (see page 127) was written in 


PORTRAN IV and ran on an IBM 360 computer for k = 1,..., 6, 


two loss functions, four values of the loss parameter, and 
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the set of prior distributions e, in E-yed =00), + 1 aaen 
Output from the program is arranged as follows: for each 
value of the number k of observations per trial, the A and 
B matrices are followed by matrices showing the expected 
value and variance of the total lcssmeugonmas— De in 
ie i = 0, +1, +2 (see page 100). In the remainder Of Miia 
section, the results of the evaluation will be discussed. 

Tables I and II show the optimal procedures in ry (that 
is, optimal number k, of observations per trial) for the 
criteria based upon the expected value and variance of the 
total loss, respectively, when the loss function is Gilgie 
linear or quadratic and the loss parameter, n, has the value 
indicated. In Table I, note that when n = 0, k = 1is 
optimal; but when n > 0, k > 1 is optimal. Note alsouunaw 
using criteria based upon expected loss, the ordering wamene | 
alternative procedures is independent of the two loss struc- 
tures used for the values of nN considered. On the other | 
hand, from Table II, it is seen that use of varianceomae 
teria is very sensitive to the loss structure. For linear 
loss structures, variance criteria tend to indicate eves 
observations per trial when compared to expected loss 
criteria and vice versa for quadratic loss structures 
general, the minimax criterion indicates optimality for 
procedures with a smaller number of observations per trial 
than the Bayes criterion relative to starting at levelugs 


Ir other words, as anticipated the minimax procedure was 


-_= 


found to be protective against a high loss resulting from 
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starting away from level 0. On the other hand, it seems 
more difficult to explain the relation between the minimax 
variance criterion and the minimum variance criterion. 
Por a linear loss structure, the minimax variance criterion 
indicates optimality for a procedure with one observation 
Merevurial which, in general, is also indicated by the 
fimemum variance criterion relative to starting at level 0. 
BubetOor & quadratic loss structure, the minimax variance 
Mieeverion, in general, was found to be protective against 
high variances resulting from starting away from level 0. 
Recall that the technique used in the preceeding section 
mememow how the Bayes procedure could be found analytically 
consisted of minimizing (66) with respect to k. Figures 2 
and 3 show the expected value of the loss, given the experi- 
ememoesins at level 0, as a function of k and n for quad- 
ratic and linear loss structures. Note the increases which 
occur at k = 4. These anomalies are a consequence of (19); 
that is, the fact that level 0 is by definition the midpoint 
of the open interval (-%, ae Note: the minima indicated 
by the curves correspond to the optimal Bayes procedures 
relative to @, in E? which are indicated in Table I; the 


0 


Curves for n = 0 are strictly increasing; the curves are 





Itt turns out that &€5 1, given by (23), is significantly 
higher for k = 4 than it fs for k = 5 agemroxri merely 0.12 
semcompared to 0.06). Thus if k = 4 and the experiment 
starts at level 0 there is a higher probability, relative to 
[eee Or 5, that the experiment will end at some level other 
than level 0. The resulting effect is a higher expected 
moss for k = 4, 
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Expected Value of the Total Loss Given 


Yo? 


the Experiment Begins at Level 0 





il 2 3 \ 5 6 


k, Number of Observations per Trial 


Figure 2. Expected Value of the Total Loss Gime 
the Experiment Begins at Level 0 as a Wiimiiay) 
of the Number of Observations per Trial and 
the Magnitude of the Loss Parameter n for 
Procedures W(5,,k,0,1) and a Quadratic Loss 
DErPUCTUre. 
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Ebxpected Value of the@lotal Boss Given 


on 


the Experiment Begins at Level 0 


peur 





1 2 3 4 5 6 


k, Number of Observations per Trial 


e 3. Expected Value of the Total Loss Given 
the Experiment Begins at Level O as a Function 
of the Number of Observations per Trial and 
the Magnitude of the Loss Parameter n for 
Procedures W(S,,k,0,1) and a Linear Loss 
PiuruUecyure . 
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asymptotic to the line r. = 2k, an asymptote suggested by 


0 
(67); and the slopes of the curves, in general, are decreas- 
ing for higher values of n. 

The results from the evaluation of some procedures in 
ry are helpful in several important ways. First, they tend 
to validate the evaluation methodology presented earlier; 
that is, the results were consistent with expectations. 
Secondly, they give insight into the selection of one of 
the criteria discussed, and lastly, some consequences of 
Che model have been brought out; for example, it might be 


that level O should be defined as the midpoint of a closed 


interval. 
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ee ee ol Cllr OhNe lO Phe ELEVATION PROCEDURE OF 
Pinieooee toon er oeCIlOION REGISTRATION 

Field artillery weapons are normally positioned so that 
femebe Dlasts from the weapons cannot be seen by ground 
observers of an opposing force. AS a consequence, projec- 
tiles fired from the weapons must be fired at targets which 
femeaely are not visible from the weapon position. Fire 
Meeeverea under these circumstances, normally from weapons 
feveea relatively low muzzle velocity, is called indirect 
fimee. Given the location of the weapon, the location of 
tiemearget, and ballistic data based upon standard weapon- 
mene r—ammunition conditions, one can compute firing 
data--direction (called deflection), elevation angle, and 
ammunition fuze setting--which under standard conditions 
Will cause the mean point of impact of the projectiles to 
be on the target. In practice, standard conditons rarely 
exist and there are usually some location and delivery 
errors. Thus, if a number of projectiles, later referred 
to as rounds, is fired at a target using standard data and 
the mean point of impact is determined, there is some 
cummulative error due to nonstandard conditions which causes 
the mean point of impact to be away from the target. The 
precision registration technique is one method which is 
used by U.S. Army and Marine Corps field artillery units 


to determine the magnitude of a correction for this error. 
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A precision registration is performed to determine, by 
adjustment, the firing data which will cause the mean point 
of impact of a group of rounds to be at a point of known 
location, called the registration point [7]. Note them 
this is at least a two dimensional problem. An adjusted 
deflection and elevation must be determined and if an 
adjusted fuze setting is desired so that air bursts are 
achieved, then it becomes three dimensional. Since the 
discussion ultimately concerns only the adjusted elevation 
it is assumed in that which follows that an adjusted fuze 
setting is not desired. In a precision registrat 10M see 
is conducted in two phases using only one weapon. In the 
first phase, called the adjustment phase, the objective is 
to adjust the mean center of impact of a group of roumeeuee 
within a specified distance of the registration point. 

This is accomplished by use of an observer who determines 
corrections and transmits them to fire direction personnel, 
Normally the observer uses a bracketing procedure. In the 
second phase, called the fire-for-effect phase, a number of 
rounds is fired to permit refinement of the mean Cengeguens 
impact. Here the observer transmits quantal responsemeem= 
only; that is, he observes where the round bursts in feu 
tion to the registration point and transmits this informa 
tion to fire direction personnel. The number of rounds used 
in the fire-for-effect phase varies randomly and the phase 


ends when a set of decision criteria are satisfied. 
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Note the similarity between the fire-for-effect phase 
Seecvhe precision registration and the bio-assay experiment. 
i@estirst round fired in the fire-for-effect phase is the 
first trial of an "experiment" being performed to estimate 
the adjusted firing data. One cannot measure the set of 
"oritical" firing data which causes the mean point of 
mmeeet to be at the registration point. He ean only select 
meee Ol Gata and then observe where the round bursts in 
memauvlon to the registration point. In addition, it is 
well known that if a large number of bursts is observed, 
Giemecne Gistribution of the bursts about the registration 
point is approximately normal. Also, the variance is known 
from previous test firings. Hence, the fire-for-effect 
phase of the registration may be viewed as an experiment?9 
to estimate the mean of a bivariate normal distribution 
having known covariance matrix. 

Separate procedures, implemented simultaneously, are 
currently used to determine the adjusted deflection and the 
adjusted elevation in the fire-for-effect phase. One is 
not dependent on the other in that the adjusted deflection 
may be determined first, or vice versa. It thus seems 
reasonable to assume that the fire-for-effect phase consists 
Sit two independent procedures. In that which follows this 
assumption has been made; that is, the elevation procedure 


STAs. when "the experiment" is referred to it is clear 


that what is meant is "the fire-for-effect phase of the 
Gepastration. ! 


ic 


is viewed as an experimental procedure for estimating the 
mean of a univariate normal distribution. It is also 
assumed that firing is to be conducted at elevation angles 
less than 45 degrees, that there is independence between 
bursts, and that the registration point 1s, in 1acueee 
point on the real line so that the probability of hiQ@pinmg 
the registration point is zero. The purpose of this jea27= 
ter is to show that the elevation procedure currentiyaee 
use belongs, under the assumptions made above, to the class 
of sequential procedures © , defined in I. A second @ptigee-. 
is to compare the efficiency of the current procedure with 


some alternative procedures inG. 


A. THE CURRENT GiiyA TON Roce puns 

The current elevation procedure, later referred to as 
the “current procedure," will now be described within the 
framework of an experiment. The fire-for-effect phase is 
entered when it is determined that a correction giver 
the observer will move the burst within a specified distance 
of the registration point. The elevation determined maem 
this, the observer's last correction, establishes the 
Nnitial level of the experiment and the first trial fempee 
formed by firing one round at the registration point seam 
the elevation corresponding to this initial level. "jeu 
first round bursts at a range gpreater (less) than tHe range 
to the registration point, it 1s said to be over (Shoe 


and the next level for the experiment is determined by 


ie 





decreasing (increasing) the elevation by an amount which 
will move the mean center of impact four range probable 
ers... Succeeding trials of the experiment are per- 
Meemiea Dy firing one round at succeeding levels until a 
burst is observed to be short (over). This establishes a 
Sm@emrork elevation bracket; that 18S, an over and a short, 
fired at levels one fork apart, have been observed. The 
next level of the experiment is the midpoint of the one 
fork elevation bracket, and the next trial is performed 
aera three rounds at this level. If the majority of 
the bursts are over (short), then the last level of the 
meememerment 1S the elevation corresponding to the short 
(over) end of the one fork elevation bracket and the last 
trial of the experiment is performed by firing two rounds 
Seems level. 

In the experimental procedure just described note 
that: Pare nUuMbecrmaa, Of rounds fimeed 15 a random variable 
Since more than two trials may be necessary to establish 
peome fork elevation bracket; the number k, of rounds fired 
Seeectrial is not constant; and successive trials of the 
experiment are not performed at successive levels. Hence, 
the current elevation procedure of the field artillery 
precision registration technique is a member of the class 
of procedures G defined in I and can be modeled by the 


general procedure W(4, Kis kes C,) ab ge osae 





One Peemeeoeaele error, PE.,, 1s approximately Oba, 
Standard deviations. Four iter is called a fork. 


(es 


Leto 7). =a eee = a eee. | Deas Of “equcian, 
spaced levels having interval m = 1/2 fork where the level 
0 corresponds to the registration pein bee: 
7i} = {-3,..., 0,...3} be a subset of 77)”. Then the eigaam. 
elevation procedure can be described as follows. The exper- 
iment (the fire-for-effect phase) begins at some (elevation) 
level Y, in 7) with one observation on the first Vries 


a 


Here, ty is in /”/ because the adjustment phase does not end 
until the mean center of impact is adjusted to witht 
specified distance of the registration point. An observa- 
tion is a response (an over) or a nonresponse (a short) 
depending upon whether the round bursts at a range g@Pearow 
than or less than the range to the registration point. 

If G@ is the distribution of bursts about the regist rama 
point when the mean point of impact is at the registragmen 
point, then the probability of a response at level j is 
G(j); g = -3,...,3. This is just the probability tmewaame 
adjusted elevation is less than the elevation used to 
perform a trial of the experiment at level j. The experi- 
ment continues at levels Yos+ee one, with Ko aeee oki g 


observations per trial, determined by: 


! 


O 
Y, a C, m Dis Oi Jy < kK, 
= O O 
Thay ty if k,“ < ot ee kK, - K, 3 
; O 
t,o C, m if kK, = Ky S Jy aes: 


where Jy is the number of responses on the t-th trialieme 
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i ee ee Cc 
= = nk — 
Ky 5 10 n I 
Ze t = n* 
are sequences of integers. The rule 6 in W(6, Ky k” C,) 


is to stop the experiment two trials after the first rever- 
sal in the sequence of responses {J,} is obtained. For 
example, if J5 = 0, J5 = 0 and J 3 = 1, then two more trials 
would be performed and n* = 5. Note that since ™ = {-3, 
».+,0,.-.-,3}+ as few as seven rounds and as many as nine 
memes May be required for the experiment since if it 
starts at level -3, as many as four rounds may be required 
to establish a one fork elevation bracket. 

When firing has been completed, the adjusted elevation 
is computed using the data from the last two trials and an 
earlier trial performed at the same level as the last trial. 
Thus six observations are used from trials performed at 
two of the levels in W~. The adjusted elevation is the 
mean elevation fired to obtain this group of six observa- 


tions Y, plus an elevation change AY, determined by: 


difference in number of overs and shorts 


eo 2 x 6 (the number of observations) x fork, 
(69) 


1) 


where the sign of the right side is negative because a 
positive difference in the number of overs and shorts 
indicates the mean elevation fired is greater than the 
adjusted elevation. Let A be the difference in overs anda 


shorts, then (69) can be written 
A-m 
bee 2 a 
6 


where use has been made of the fact that m = = fork. lhLet 


Jin be the total number of responses (overs), then 


= 2d, - 6 


A=4J, - (6 - Jim) ~ 


ib 


so that the adjusted elevation may be computed using the 


estimator 


- , n* 
m 
a Se Se ia (7a 
cee 2 el 


Note that if the total number of responses is three @umems 
is, if there are three overs and three shorts), then the 
last two terms of (70) sum to zero. 

“Uiven the Tripler \(777ee Y) the procedure transagaen 
and iteration matrices can now be determined from (10) and 
(11). Let Q be a discrete random variable with distribution 
funetion F which denotes: the levet Y, in Al at which the 
experiment begins. Q is a random variable because v4 is 
determined by a process of adjustment which is subj eGtwee 
random error. Indeed, if the interval m between levels in 


M/)is large, then the distribution may concentrate nearly 





mmerlos mass at level 0. Let M be a discrete random 
variable which denotes the level in 7”) which represents 

the adjusted elevation. Recall from II, that M represents 
meen tve Set Of midpoints of disjoint intervals, the union 
Seewidich forms an open interval on the real line. Thus 

the adjusted elevation can be represented by one of the 
fevels in 7) and the joint conditional probability 

fu niq'd> Meee | = =55,..0,...,3; Nn = (,0,9) that the 
experiment ends at some level j in 7) after n rounds have 
meee tred given it begins at level i, can be found using 
@eeeeco) and a logic tree similar to that shown in Figure 1. 
mecna. a (7 x 1) column vector of probabilities that the 
Eeeeriment starts at level i, be a prior distribution on Q. 
mies t,jJ-th element of the Procedure Transition Matrix A 
(the probability that the registration ends at level ; 


given the fire-for-effect phase begins at level i) is 
9 
z Eu NIQ Gj 2 Graybel,) (71) 
and the probability that the registration ends at level j, 
meee by (35), is 

Pro UML = aE es (Glee lea 


Likewise, the i,j-th element of the Procedure Iteration 
Matrix B (the probability that the registration ends after 
J rounds have been fired, given the fire-for-effect phase 


begins at level i) is 


(le 


3 
Pag 7 aeig “MNIQ S™ 54) oe 


and the probability that the registration requires )] @oue 


given by (37) is 
ee = ee) = Ce. 


The current procedure can now be evaluated using a loss 
plus cost objective function in a manner analogous To 
Wald's approach. If H is a random variable which denotes 
the loss associated with a registration that endS a2UyP a 
level in 7// other than level 0 and the loss is measuneqmaam 
units of the cost of a round, then the total 10ss Daa 


measured in units of the cost of a round, is given bys 





That is, 


Here, other costs incidental to the experiment are assumed 
to be constant and thus may be neglected for purposes of 
this evaluation. It appears that (33) is a reasonapme 
objective function for the elevation procedure of the 
precision registration. An adjusted elevation which makes 
the total loss as low as possible would be preferred. Con- 
Sider, for example, the consequences of deciding that the 
adjusted elevation is at level -3. This means thatuweuieeee 
quent firing using the adjusted elevation as a basis muom 


corrections will, on the average, be short by six range 


78 





meopabple errors, a situation that may be intolerable if 
fires are to be delivered close to friendly forces. Indeed, 
memo reasonable that, in certain circumstances, a high 
loss be associated with making such a decision. Although 
the nature of the loss function h(j) may not be known, one 
Stfeseveral intuitively plausible loss functions may be 
Meeeritor the evaluation. This point will be considered 
below in more detail. 

Lat Ay is a (7 x 1) column vector whose j-th component 
meme LOSS associated with a registration which ends at 
i eemereolomcolum: vector, n. = (7, 8, 9), 


il al 
then the expected total loss, given by (39), is 


level j andn 


where use is made of (35) and (37). Likewise if hs is a 
(7 x 1) column vector whose j-th component is the square of 
the loss associated with a registration which ends at level j 


and ils jesse) ( 251) column vector n, = 


the variance of the total loss, given by (56), is 


(49, 64, 81), then 


where c = A ho + Bn, + 2C hy feet, x 1) column vector, 
B 


5 | 
HI 
—“~ 
> 
J | 


- 2 a) imme S (J positive semi- 


Seaoinice symmetric matrix having rank one, and C hy eS emicl 


(7 x 1) column vector whose i-th component is the product 


moment of the random variables H and N given the experiment 


ie 


starts at level i. The reader is referred to flit item 
more detailed derivation of the variance of the total loss. 
Given 7), the statistical properties of the current 
procedure can be determined using (71) and (72). For 
example, the probability that the procedure uses J Foumeee 
given fire-for-effect starts at level i is given by (72). 
The efficiency of the procedure can be determined for any 
finite loss structure from (39) and (56). Further discus= 
sion of the current procedure will be deferred to a later 
paragraph where its properties and efficiency can be com- . 
pared with those of two alternative procedures which are 


discussed in the next section. 


B. ALTERNATIVE ELEVATION PROCEDURES 

An elevation procedure which was used in the precision 
registration technique prior to 1965 will now be discussed. 
For convenience, this procedure will be referred to as the 
"old procedure." Essentially, the old procedure differs 
from the current procedure in that a one fork elleyaruren 
bracket is not obtained prior to firing the initial@mome 
of three rounds and all subsequent firing is in groups of 


three rounds. That is, the first trial of an experimens 


performed with the old procedure begins at some level v4 a 
7] with three observations. The experiment continues at 
levels Toots atin with three observations per trial, deter- 
mined by: , 
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Y, + m dig Jy = 0 
Yeagy = Y, gli: J, Slice iy cape 
Y, - m ae Jy = 3 


where m = 1/2 fork and Jy is the number of responses (overs) 
on the t-th trial. The experiment ends when both responses 
em@omnonresponses have been obtained on two successive 
trials. Note that the old procedure can be denoted 

WOS, ; 3, 0, 1), a procedure in rs. Note also that 

6 [eer ec! Since the experiment could conceivably start at 
level -3 and not obtain a response until level 3 is reached. 


When firing is completed the estimator given by (70), where 


n¥ 
Jp Se J 


5 
Sa eee 


is used to compute the adjusted elevation. 

A second alternative to the current procedure is the 
meeified up-and-down method with a "nominal" sample size 
of six described by Dixon [4]. This procedure will be 
referred to as the "bio-assay procedure." Under this pro- 


cedure, the experiment begins at some level Y in 7) with 


al 

S@ewovDservation on the first trial. The experiment con- 

Cinues at levels Y.,...,Y.3, with one observation per trial, 
2 n* 


determined by: 


il 
O 


Y, +m et: = 44) 


KK 
il 
ct 
[ Vv 
— 


ttl Woo @ a 


Il 
JY 
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where m = 1/2 fork and J, is the number of responses (overs) 


1p 
on the t-th trial. From II this procedure can be denoted 
W(S5; 1, 0, 1) where the rule 55 is to perform four more 


trials after the first reversal in the sequence Of FrespG@aeeE 


{J,}. Here 6 <n < 11 because the first reversal comma 





occur as soon as the second trial and as late as theweee ia 
trial (that is, start at level -3) and not obtain a response 
until level 3 or vice versa). Note that the rule 65 is ; 
more liberal than 65 in that its use permits four more 

trials (instead of no more) after the first reversal. 

When firing is completed, the adjusted elevation is deter- 


mned from the estimator 


KK > 


= lee + Km (72) 


where Y,y is the last elevation fired, kK is a constant 
(see Table I of reference 4) which depends upon the sequence 
{J,} and m is the interval between levels. Equation 73 was 


empirically constructed by Dixon and is essentially eqmive= 





lent to 
es 1 n* +1 
Y = by oo 
6 oe i | 
for a nominal sample size oflsix,eenere ws is the level 


nda i 
that would be used if one more trial was conducted. For 
example if m= 1, Oo =i Ogee el ce sel eall) banana {J, } = 


(0.0 .180, 2,1). wee rete Y E41 = -l and Y = > while use of (73) 


gives Y = 0.732. 
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C. AN EVALUATION OF THE CURRENT ELEVATION PROCEDURE AND 
SOME ALTERNATIVES 


A comparison of the three alternative elevation pro- 
eedures described above is presented in this section. For 
convenience the alternatives will be referred to as 
fea LOws : 

A - The old procedure 
B - The bio-assay procedure 
C = The current procedure 
The objective function defined by (33) was used with two 


moor unctvions given by 


NEP) 2 njc jo Se eee (7h) 
at - 3,2, 1 
nal) =) (75) 
0 otherwise 


Bieeesi) 1s an arbitrary constant which determines the magni- 
tude of the loss. Note that h, is both quadratic and sym- 


iewrere 1n j, while Ny is asymmetric. The loss function No» 
which appears to be a reasonable when fires are to be 
delivered just beyond friendly forces, associates a high 
loss with the decision that the adjusted elevation is less 
than the true adjusted elevation and no loss with the con- 
verse decision. The criteria used in the comparisons are 
Peyen by (43), (45), (58), and (60). 


A computer program, similar to that shown on page 127, 


was written in FORTRAN IV and ran on an IBM 360 computer to 
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evaluate equations 39 and 56 for the loss functions hy and 
Dy and various values of the loss parameter. The set of 
all unit vectors in Euclidean seven space, S in Bi, was 
taken as a set of prior dist riour tone werec. 

A summary of the statistical properties oferta. 
various procedures given that the fire-for-effect phase of 
the registration begins at level 0 is given in Table III. 
The data in the table are the center rows of A and B 
matrices which are shown on pages 118, 121, and 124, respec- 
tively for procedures A, B, and C. The table is ineiiaded 
to permit an appreciation of the relative merit Cf jem. 
various procedures given the fire-for-effect phase starts 
at level 0. Data for other starting levels is contained 
in the other rows of the A and B matrices. The data con- 
tained in the table should not be used as a basis of 
deciding that a particular procedure is best; rather, one 
of the criteria discussed III Al, III A 2, It) Bee 
III B 2 might be used. 

Computations of the expected loss and variance of the 
loss are shown for both loss functions and seven Valiieeue 
the loss parameter beginning on pages 119, 122, and I25eion 
procedures A, B, and C, respectively. The first cCOliimmean 
each matrix, the expected loss and variance of the ieee 
when the loss parameter n is zero, is equivalent to The 
expected value and variance of the number N, of rounds 


fired during the fire-for-effect phase. To see this, the 
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reader is referred to the discussion of the expected value 
and variance of the loss in III. Figure 4 shows plots of 
the expected value and variance of the total number of 
rounds as a function of the starting level. There eae 


indicated Bayes procedure relative to Ss € ot are: 


Procedure A for 1 O, +1, Procedure B for i = +2, (ame 
Procedure C for i = +3. And the minimax procedure iia 
Thus, if there is no loss associated with deciding wees 
the adjusted elevation is at level M, it is seen thageiee 
of the current procedure gives protection against high 
losses resulting from staring away from level 0. ‘igame 
result is characteristic of a minimax procedure. Notice 
that varlance criteria provide different candidates 
the optimal procedure. Procedure A is the minimum Variamee 
procedure relative to ey ce E’ while Procedure C ia .ten 
the minimum variance procedure relative to Si e E! for 

i #0 and the minimax procedure. These results are inter- 
preted to mean that, in the long run, the use of Prog@eaim. 
A or B may result in a smaller expenditure of ammunition; 
but, the use of Procedure C will result in a near Gomes 
expenditure of ammunition per registration. It is iii 
esting to note the differences between Procedures A and C. 
Note from Figure 4 that use of Procedure A results in a 
Smaller expected number of rounds if the fire—-for-efmeme 
phase starts at level i, 1 = 0, +1. In practice, however, 


the starting level cannot be fixed with certainty. “lige 
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@, The Level at Which the Fire-for-Effect Phase 
Starts (Spacing Between Levels is PE.) 


Figure 4. Expected Value and Variance of the Number 
of Rounds Fired in Fire-for-Effect for Procedures 
A, B and C as a Function of Starting Level (Here 
the Loss Parameter n is Zero). 
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the basis for adoption of the current procedure (C), was 
that an occasional observer error in the adjustment phase 
would, when using the old procedure (A), result in an 
excessive number of rounds [16]. While the results shown 
in Figure 4 substantiate this decision, the reader is 
reminded that here the loss parameter is Zero; that is, to 
choose a procedure on the basis of expected value and vari- 
ance in the number of rounds may be equivalent to deciding | 
that there is no risk associated with deciding that waa. | 
adjusted elevation takes on some value other than the true 
adjusted elevation. 

Suppose the loss structure can be represented by ny > 
the quadratic loss function given by (74). Figure 5 shows 
the expected value and variance of the total loss as a 
function of starting level for a quadratic loss structure 
when the loss parameter is 50. Note that Procedures A 
and/or B satisfy all of the criteria. Procedure A is both 
the Bayes and minimum variance procedure relative to 
iA E gE! for i = 0, +1. Procedure B is the Bayes and minimum 
variance procedure relative to = 2 onl Were Te +2, £3 
addition, Procedure B is both the minimax and minimax 
variance procedure, replacing Procedure C which satisfied 


these criteria under the no loss assumption. In faqpamuems 


appears that Procedure B gets "better" as the distance 





between the starting level and the registration point 


increases. This result is surprising and may be due upemeeme 
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Q, The Level at Which the Fire-for-Effect Phase 
Starts (Spacing Between Levels is 201s) 


Figure 5. Expected Value and Variance of the Total 
feos se totebroceccmmees A, B and C as a Function. of 
the Starting Level When the Loss Structure is 
Quadratic and the Loss Parameter n is 50. 


use of (73) in computing the adjusted elevation. Note also 
the magnitude of the variance of the total loss. Table IV 
shows optimal procedures under the various criteria for 

the values of the loss parameter n considered when the loss 
structure is quadratic. It can be seen that for 7) samme 
the ordering among the alternative procedures is independent 
of the magnitude of the loss parameter n. Recall this was 
not true in III C 2 where evaluation of some procedures in 
Py: including Procedure A, was discussed. Here, UNiSiigeaiae. 
essentially means that one need not be concerned with 
determining how large a loss may be suffered; rather he 
Should deal with the more important issue of determining 
whether or not a loss will in fact be sustained and Timege 
whether or not a quadratic loss structure is appropriate. 
It should be noted that the result may not hold for ™iaiaae:. 
values of the loss parameter. Another interpretation of 
the data in Table IV is that Procedure B is more conserva- 
tive than Procedure A. This can be seen by noting first 
that Procedure B is, for n > 0, both a minimax and mime 
varlance procedure, and that Procedure B is both a Bayes 
and minimum variance procedure relative to ey € E! for 

i = te, +3. In other words, use of Procedure B givesmomem 
tection against high losses and variances resulting from 
starting the fire-for-effect phase away from level 0. Note 
however that in case it can be assured that the fire-for- 


effect phase starts at levels 0 or +1 (that is, witha oe 
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of the registration point since level 1 is the midpoinvgaa 
an interval of length 2 ey then Procedure A is best for 
nm 2 TOF 

Perhaps a more realistic loss structure in some Ga 
is one which is asymmetric. If 10 can be represenlcama 
hj, given by (75), then the decision maker is confronted 
with a different situation. Recall the interpretatieGuma 
Ay is that there is a high loss associated with decicaia, 
the adjusted elevation is less than the true adjusted ele- 
vation and no loss is associated with deciding that uma 
greater than the true adjusted elevation. Figure 6 shows 
the expected value and variance of the total loss as a 
function of starting level for an asymmetric loss struc-= 
ture when the value of the loss parameter is 50. Note the 
trends in this situation. Procedure A varies widely depend- 
ing upon the starting level. Procedure B again appears to 
be better when the fire-for-effect phase starts away 
from the registration point, weretemrarin st. om below. @ Eres 
cedure C is fairly consistent at about midway between the 
extremes noted for Procedure A. Here also, Procedures A 
and/or B dominate Procedure C with respect to all the 
criteria. Note that both the expected value and variance 
of the total loss take on larger values than they did in 
the previous case. Table V shows the procedures which are 
optimal under the various criteria for the values womeme 


considered when the loss structure is asymmetrics Nome 
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E [Ll], Bxpeceredslorval Loss 
(in Number of Rounds) 


Var [L], Variance of the Total 
Loss (in Number of Rounds) 
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Q, The Level at Which the Fire-for-Effect Phase 
Starts (Spacing Between Levels is 21a) 


Figure 6. Expected Value and Variance of the Total 


Hose [ors rrocedures A, B and € as a Function 
of Starting Level When the Loss Structure is 
Asymmetric and the Loss Parameter nis 50. 
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m@eueit) this case the ordering is also unchanged for 
meee. Again it is seen from the data in Table V that 
Procedure B tends to be conservative. It is interesting 
memobserve that if an asymmetric loss structure is valid, 
then the expected value and variance of the loss can be 
greatly reduced by use of Procedure A and by assuring that 
the fire-for-effect phase always begins at a point beyond 
tiemresistration point. 

Pmeconcluding, 1t should be emphasized that the purpose 
Smeets chapter has not been to select an optimal elevation 
procedure, rather to show how the current procedure can be 
modeled and to define its degree of optimality by means of 
comparison with some alternative procedures. The current 
procedure was shown to be conservative under ano loss 
assumption; that is, it was found to be a minimax procedure 
when the basis of the evaluation and comparison was the 
expected number of rounds fired during the fire-for-effect 
Pateee Ot Che registration. It was shown that if a loss 
structure exists and can be represented by either of the 
eee unctCions h. or h 


dk 2 


mmeeeecure 15 nov optimal with respect to any of the criteria 


SOG): JO, then tme current 


Pem@enoaered. In particular, if the loss structures con- 

Sidered are valid, then for n > 0 the bio-assay procedure 
Strictly dominates the current procedure and the old pro- 
cedure dominates the current procedure relative to prior 


distributions Sy ce E! for i = (a eiinese results 


NS 


suggest that further study of the elevation procedurcm 
warranted. Indeed, it may be possible, using the bio-assay 


procedure, to enter fire-for-effect more rapidly than is 


currently the case. 
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V. SUMMARY AND CONCLUSIONS 


Peeclass Of Sequential procedures for estimating the 
lean of a normal distribution function with known variance 
from quantal response data has been discussed. An experi- 
ment conducted using a procedure belonging to the class is 
characterized by: 1) a random number of trials, 2) a 
number of observations per trial that is not necessarily 
constant throughout the experiment, and 3) a sequence of 
Crials That are not necessarily performed successively at 
equally spaced levels. It was seen that the general pro- 
cedure W(s6, ky, ke”, Ci )s called a modified Tsutakawa ran- 
dom walk design, depends upon the stopping rule 6 and the 
sequences {k, 1}, ik ae and {C.}. iiemelasc ot Cenera 1 
procedures was seen to include the up-and-down method and 
the Tsutakawa random walk design as special cases. Two 
matrices. the Procedure Transition Matrix and the Procedure 
Iteration Matrix, were found to characterize the general 
procedure. A technique of evaluating the efficiency of 
the general procedure was presented which is essentially 
an application of Wald's decision theory. It was seen 
that a loss plus cost objective function can be used along 
With one of the four decision criteria discussed to deter- 
mine which among a set of alternative procedures is best. 
Matrix equations for the expected value and variance of 


the total loss were derived which depend upon the a priori 


oki 


distribution on the starting level, the stoppine = aie 
the estimator used to determine the mean, and the loss 
SULuUeEure: 

In the special case, procedures of the form 


W(6 k, 0, 1) were examined in some detail for k = 1,...,;6 


1? 
and a particular estimator. It was found that choosing a 
number k* of observations per trial which minimizes the 
expected total loss is equivalent to choosing a Bayes 
procedure. It was also found that whether or not k* > 1 
depends upon the magnitude of the loss which is associated 
with the decision that the estimated mean has some) 74am 
other than the true mean. In the special case, it was 
seen that the choice of a stopping rule is critical when 
defining a set of alternative procedures. A rule that 
Stops the experiment too quickly may result ine compari 
experiments which have different sample sizes. 

Three alternative elevation procedures for the field 
artillery precision registration technique, used by the 
U.S. Army and Marine Corps were discussed and compared. 

It was seen that the current procedure may be considered 
optimal when there is no loss associated with the decision 
that the adjusted elevation has some value other than the 
true adjusted elevation. When there is a loss associated 
with this decision which can be represented by one of the 
loss functions considéred, it was seen that Dixomi™s, 


modified up-and-down method strictly dominates the current 
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mmeecedure. The author believes that this result is signi- 
ficant and that the up-and-down method should be further 
evaluated as a candidate elevation procedure for the 
Peecision registration technique. 

It appears that further work in this general area of 
research would be justified. In particular, it would be 
interesting to study the various procedures under different 
stopping rules and to investigate the effect of the use of 
Various estimators and loss structures. It would also be 
of interest to investigate multivariate analogs of some of 
the procedures. Indeed, it may be possible to model the 
fire-for-effect phase of a precision registration with a 


two or three dimensional version of the up-and-down method. 
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